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ABSTRACT 

This information bulletin provides an overview of 
some of the documents that were identified as a result of limited 
searches of the literature related to science education attitude 
research and highlights some of the problems and concerns involved in 
this research. Major areas considered include: (1) problems of 
defining scientific attitudes; (2) attitudes toward science; (3) 
attitude measurement techniques; (4) methodological issues; (5) Hugh 
Nunby's investigation of attitude measurements ("An Investigation 
into the Measurement of Attitudes in Science Education**); (6) 
recommendations for improving attitude research; and (7) 
implications* A list of references cited (with ED numbers for 
documents in **Resources in Education**) and related references is 
included. (JN) 



*********************************************************************** 

* Reproductions supplied by EDRS ara the best that can be made * 

* from the original document. * 
*********************************************************************** 



ERIC 




Clearinghouse 
for Science, {Mathematics 



UA M^AHTKmr 09 imiOATioii 

NATIONAL INITITUTt Of IDUCA1K)N 

iOUCATlONAl MSOUKCiS INFORMATION 
J CENTifl (ifllC) 

If Th« docunwnt Hm ^mh f«produe«d M 
rtctivwl ftom xtm ptnon or ofQtnUatlon 
ofiQiMtrng It. 
; : MK\or ch«noti havt bMn mtdft to improvt 
rtproduction quality 



• Point! of v»3w or opinion! !tit«d in thi! docu- 
ff>«nt do not nKtiiarily rtpruvnt offlctol NIE 
DO«tion or policy. 

and Environmental Education 



o^ 

Information Bullttin 

CM 




No. 1,1984 



Attitude Research in Science Education 



EDITOR'S COMMENTS 

Several years ago Wayne W. Welch 
made a presentation at a science ed uca- 
tion meeting in which he characterized 
the situation in ':cience learning by say- 
ing that students were learning less 
science but enjoying it more. Science 
educators of students at varying educa- 
tional levels are interested not only in 
their students' achievement but also in 
producing positive attitudes about sci- 
ence. This information bulletin is de- 
signed to provide readers with an over- 
view of studies in attitude research. It 
was prepared by Patricia E. Blosser 
Associate Director. User Services. 

Introduction 

Several years ago the National Science 
Teachers Association (NSTA) issued a 
position statement titled "Science-Tech- 
noiogy-Society: Science Education for 
thx3 1980s," (1982) In this statement com- 
mittee members identified some prob- 
lems they felt were indicative of a crisis 
in science education. Among these prob- 
lems were a decline in public apprecia- 
tion for science, decreased support for 
sci3nce education, an increasing num- 
ber of problems rolated to science*-gen- 
erated technology that have an impact 
on the quality o* life, and the under- 
representation of women, minorities, 
and handicapped persons in "nearly all 
professional and technical roles in sci- 
ence and technology." 

The committee's thesis was that scien- 
tific literacy was basic for living, working, 
and decision making in the 19803 and 
beyond. Attributes that characterize a 
scientifically literate person were listed. 
Some of these attributes were of the cog- 
nitive know'edge variety. Others related 
to the affective domain of science edu- 
cation. For example, according to the 
position statement, 

. . . The scientifically and techno- 
logically literate person: 
. . . appreciates science and tech- 
nology forthe intellectual stimulus 
they provide: 

. . . distinguishes between scien- 
tific evidence and personal opin- 
ion; 



. . . recognizes the origin of sci- 
ence and understands that scien- 
tific knowledge is tentative, and 
subject to change as evidence ac- 
cumulates; 

. . . has a richer and more exciting 
view of the world as the result of 
science education . . . (1982) 

While no teachers would quarrel with 
these objectives, they might ask how 
they were to design curriculum and in- 
struction to lead to their attainment, and 
how this attainment was to be measured. 
Science teachers are accustomed to 
dealing with, and attempting to measure, 
cognitive objectives in their classes. 
Getting a handle on the affective aspects 
of science education appears to present 
some problems. Researchers in science 
education have attempted to deal with 
the affective domain primarily through 
the investigation of attitudes. 

The Literature Bate 

It is easy to get an idea of the amount 
of material related to attitudes and sci- 
ence education research by doing a com- 
puter search of the ERIC data base. For 
example, in November 1984, a computer 
search of relevant descriptors resulted 
in the following document counts: 



Dttcriptor 

attitudes 

attitude measures 
scientific attitudes 
teacher attitudes 
student attitudes 



Numbtr of 
Documtnts 

62,417 
2,166 
491 
12.836 
16,429 



When the descriptors "science educa- 
tion" and "research" were added to fur- 
ther delimit the search, the new counts 
were: 



Dttcriptor Combination 

science education ^ 
research > attitudes 
science education * 
research attitude 
measures 

science education ^ 
research > teacher 
attitudes 



Numbtr of 
Documtntt 

962 



57 



213 



science education ^ 

research * student 

attitudes 398 

research * scientific 

attitudes 243 
It would appear that the investigation of 
attitudes in science education has re- 
sulted ina large number of publications. 

The Purpose of This Bulletin 

The purpose of this Information bulle- 
tin is to provide the reader with an over- 
view of some of the documents that were 
identified as a result of limited searches 
of the literature related to science educa- 
tion research of attitudes and to high- 
light some of the problems and concerns 
involved in this research. 

Sume Problems of Definition 

One of the problems in attitude re- 
search in science education is that of 
finding a clear definition of what is 
meant by "science attitudes." Some re- 
searchers appear to be investigating 
scientific attitudes while others are 
studying attitudes toward science. Gard- 
ner discussed this difference, writing 
that attitudes toward science always 
have "... some distinct attitude object 
to which the respondent is invited to 
react favourably or unfavourably ..." 
while the scientific attitudes category Is 
composed of traits "... better de- 
scribed as styles of thinking which sci- 
entists are presumed to display." 
(1975:1-2) 

Scientific attitudes: Ina Journal article 
published in 1982 Gauld provided an 
amplified description of what constitutes 
the "scientific attitude:" 

The scientific attitude as it ap 
pears in the science education lit- 
erature embodies the adoption of 
a particular approach to solving 
problems, to assessing ideas and 
information or to making deci- 
sions. Using this approach evi- 
dence is collected and evaluated 
objectively so that the idiosyn- 
cratic prejudices of the one making 
the judgment do not intrude. No 
source of relevant information is 
rejected before it is fully evaluated 
and all available evidence Is care- 
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fully weighed before the decision 
Is made, If the evidence is consid- 
ered to be insufficient then judg- 
ment IS suspended until there is 
enough information to enable a 
decision tobe made. No idea, con- 
clusion, decision or solution is ac- 
cepted just because a particular 
person makes a claim but it is 
treated sceptically and critically 
until its soundness can be judged 
according to the weight of evi- 
dence which is relevant to it. A 
person who is willing to follow 
such a procedure (and who regu- 
larly does so) is said by science 
educators to be motivated by the 
scientific attitude. (1982:110) 
Two years earlier, Gauld and HuKlns 
• published a review of the literature on 
scientific attitudes, using those studies 
fitting Gardner's definition. (The 1982 
article from which the quotation was 
taken was a critical reappraisal of the 
situation.) In the 1980 article Gauld and 
Hukinssaid that philosophies of science 
imply different conceptions of scientific 
attitude, but people do not seem to real- 
ize this. As a result, there i i inadequate 
theoretical framework in the research 
literature of scientific attitudes and in 
attitude measurement. 

Gauld and Hukins considered that the 
concept of scientific attitude has two 
main dimensions: a scientific one, deal- 
ing with the nature of scientific activity, 
and an affective or attitudinal one. 

They identified three broad groups 
into which components of the scientific 
ttitude as described in the literature 
might be classified: 
Group 1. General attitude towards 
ideas and information (e.g. curiosity, 
open-mindedness. scepticism, hu- 
mility, antiauthoritarianism, crea- 
tivity) 

Group 2. Attitudes related to the eval- 
uation of ideas and information (e.g. 
critical-mindedness - including ob- 
jectivity, intellectual honesty, cau- 
tion when drawing conclusions or 
making decisions) 

Group 3. Commitment to particular 
(scientific) belief (e.g. loyalty to 
truth, belief in the understandability 
of nature, existence of natural cause 
and effect relationships, lack of 
foundation for superstition) (1980: 
133) 

Readers are probably familiar with 
one of the more influential publications 
dealing with the scientific dimension of 
the scientific attitude concept, the Edu- 
cational Policies Commission's 1966 
document entitled '^Education and the 
Spirit of Science." In the recommenda- 
tions section of this document, the 
writers urge that schools promote 
. . . understanding of the values 
on which science is everywhere 
based. . . . We believe that the fol- 
lowing values underlie science. 
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1 . Longing to know and to 
understand 

2. Questioning of all things 

3. Search for data and their 
meaning 

4. Demand for verification 

5. Respect for logic 

6. Consideration of premises 

7. Consideration of conse- 
quences . . . (1966:15) 

The members of the Educational Poli- 
cies Commission believe that "... the 
values of science are the most complete 
expression of one of the deepest of 
humane values— the belief in human dig- 
nity." (1966:16) This is one justification 
for the importance of developing a scien- 
tific attitude in students. Gauld and Hu- 
kins present two other reasons: such an 
attitude helps students have ,a better 
understanding of the nature of the scien- 
tific process by acting out the role of a 
scientist, and It is important for all stu- 
dents in their everyday lives, indepen- 
dent of the supposed importance of sci- 
entists, to be rational thinkers (1980: 
140). 

Again, questions are raised relative to 
instruction and evaluation. What should 
science teachers do? What should be 
done to measure success? Nay and 
Crocker developed an inventory of the 
affective attributes of scientists which 
they reported in an article published 
in :970 In Science Education. They 
g. ^ jped selected attributes of scientists 
onfivecomponentsconsiderec^by Krath- 
wohl as part of the affective domain: 
anpreciations, interests, attitudes, values 
and beliefs, and adjustments. Nay and 
Crocker's inventory is shown below: 

1. Interests 

(The motivation for a person to be- 
come a scientist and continue to be 
one.) 

1.1 Understanding natural phenomena 

1.11 Curiosity 

1.12 Fascination 

1.13 Excitement 

1.14 Enthusiasm 

1.2 Coniributing to knowledge and human 
welfare 

1.21 Altruism 

1.22 AiTiDition 

1.23 Pride 

1.24 Satisfaction 

2. Operational Adiustments 
(Primary behaviours which underlie 
competence and success in science, 
and performance at recognized stan- 
dards.) 

2.1 Dedica'.ion or commitment 

2.11 Perseverance (persistence) 

2.12 Patience 

2.13 Self-discipline 

2.14 Selflessness 

2.15 Responsibility 

2.16 Dependability 

2.2 Experirrental requirements 

2.21 Systematism (methodicalness) 

2.22 Thoroughness 



2.23 Precision 

2.24 Sensitivity 

2.25 Alertness for the unexpected 
2.3' Initiative and resourcafulnaas 

2.31 Pragmatism (common-sense) 

2.32 Courage (daring, venturesome* 

ness) 

2.33 Self-direction (Independence) 

2.34 Self-reliance 

2.35 Confidence 

2.36 Flexibility 

2.37 Aggressiveness 
2.4 Relations with peers 

2.41 Cooperation 

2.42 Compromise 

2.43 Modesty (humility) 

2.44 Tolerance 

3. Attitudes or Intellectual . 
Adjustments • 

(Intellectual behaviours which are 
foundational to the scientist's contri- 
bution to or acceptance of new scien- 
tific knowledge.) 

3.1 Scientific Integrity 

3.11 Objectivity 

3.12 Open-mindedness 

3.13 Honesty 

3.14 Suspended judgment (restraint) 

3.15 Respect for evidence (reliance 

on fact) 

3.16 Willingness to change opinions 

3.17 Idea sharing 

3.2 Critical requirements 

3.21 Critical mindedness 

3.22 Skepticism 

3.23 Questioning attitude 

3.24 Disciplined thinking 

3.25 Anti-authoritarianism 

3.26 Self-criticism 

4. Appreciations * 
(Relative to the foundations, interac- 
tions, and dynamics of science.) 

4.1 The history of science 

4.11 Theevolution of scientiflcknowl- 

edge 

4.12 Contributions made by Individual 

scientists 

4.13 The exponential growth of sci- 

ence 

4.2 Science and society 

4.21 The social basis of the develop- 

ment of modern science 

4.22 The contribution made by sci- 

ence to social progress and 
melioration 

4.23 The relationship between sci- 

ence and technology 

4.24 The interaction of the "two 

cultures" 

4.3 The nature of science 

4.31 The process of scientific Inquiry 

4.32 The tentative and revisionary 

character of scientific knowl- 
edge 

4.33 The strengths and limitations of 

science 

4.34 The value of one's own contribu- 

tion and the debt owing other 
scientists 

4.35 The communality of scientific 

ideas 

♦ 4.36 The esthetics and parsimony in 
scientific theory 

4.37 The power of individual and co- 

operative effort 

4.38 The power of logical reasoning 

(rationality) 
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4.39 Thecasual, relatlvlstic, and prob- 
abilistic nature of phenomena 

5. Values and/or BellBts 

(In the realm of philosophy, ethics, 
politics, etc.) 

5.1 Philosophy 

5.11 The universe is "real" 

5.12 The universe ls.comprehenslble 
(knowable) through observation 
and rational thought 

5 13 The universe Is not capricious 

5.2 Ethical 

5.21 Science is amoral but scientists 
have the responsibility to inter- 
pret the consequences of their 
work 

5.22 Humanism is the highest ideal 

5.3 Social 

5.31 Science must serve the needs of 
society 

5.32 Science flourishes best in a free 
and democratic society 

(1970:61-62) 

Nay and Crocker said that the science 
teacher was the key to successfully pro- 
moting such affective attributes in stu- 
dents. The science teacher needs to 
have a good knowledge of the nature of 
the scientific enterprise and must be a 
good role model. Students may perform 
experiments or do laboratory research, 
or they may read science case histories. 
Students may also solve problems which 
they identify or which the teacher sup- 
plies, using the processes involved in 
sciantificlnquiry. (1970:65). 
' These suggestions speak to the ques- 
tion of instruction. What about evalua- 
tion? Problems related to the measure- 
ment of attitudes will be discussed in a 
later section. There are other problems 
to be considered relative to scientific 
attitudes. 

Gauld (1982) said that a great deal of 
effort has been devoted to Identifying 
the nature of the scientific attitude. Most 
of the work has involved detailed analy- 
ses of the writings of scientists, philoso- 
phers of science, and science educators. 
Much of the material was the work of 
philosophers of science who looked at 
science from an empiricist perspective. 
As a result, the concept of scientific atti- 
tude has an empiricist emphasis. Little 
research has been done to see if scien- 
tists do possess the affective character- 
istics attributed to them. Gauld cited the 
work of Mahoney who examined the 
extentto which scientists possessed the 
characteristics of objectivity, rationality, 
open-mindedness. superior Intelligence, 
integrity, and communality. The data 
Mahoney obtained produced a picture 
of "real" scientists that was different 
from that in science education literature. 
Practicising scientists displayed both 
objectivity and emotionality, open- 
mindedness and tenacity, depending on 
the Situation (1982:112-113). 

Gauld suggested that science educa- 
tors need to consider Holton's distinc- 
tion between "public science" and "pri- 

O 
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vate science." Holton said that the way 
in which arguments and evidence are 
publicly presented is not the way they 
were originally conceived, clarified and 
tested (private science). However, the 
public science image is that of the de- 
tached, impartial scientist. Gauld con- 
cluded that "... If the distinction be- 
tween 'public' and 'private' science Is a 
valid one. it means that the attitudes 
toward scientists held by science educa- 
tors and science students can be expec- 
ted to have little, if any, necessary con- 
nection with the personal characteristics 
of scientists." (1982:117) 

Gauld argued that 

. . . development of the scientif ic 
attitude in students should be elim- 
inated as one of the major goals of 
science education, and this cer- 
tainly follows for the attitude as it 
has been formulated by science 
educators for the past 60 years. 
Teaching that scientists possess 
these characteristics is bad enough 
but it is abhorrent that science 
educators should actually attempt 
to mold children in the same false 
image . . . (1982:118) 

Gauld has suggested that terms such as 
open-mindedness. objectivity, skepti- 
cism need to be clarified and the way In 
which they relate to scientific practice 
needs to be more carefully d'scussed so 
that it may be possible to develop a re- 
formulated and more acceptable version 
of what is meant by scientific attitude. 

This is i large task. It is not appareat 
from a review of the existing literature 
that scienpe educators are working on it 
or that th|9y are even aware of Gauld's 
review and criticisms. If. and when, such 
a task is begun, science educators need 
to look at the nonempiricist philoso- 
phies of 'science that have been pub- 
lished sirjce 1960 (Gauld, 1982:117). 

Perhaps we need to remember not 
only the Educational Policies Commis- 
sion's seven values underlying science 
but also some of the discussion that fol- 
lowed the listing of these values: 

. . . like other sets of values, they 
have the defect that neither indi- 
vidually norjointly dothey provide 
a fully adequate guide to action; in 
many concrete human situations, 
various values, all cherished, are 
involved, and the choice of action 
involves an ethical compromise. 
The valges of the spirit of science 
express the belief that the com- 
promise is likely to be better if 
based on thoughtful choice; in this 
respect they differ from those value 
systems which hesitate to submit 
all problems to reason . . . 

By their very nature, these values 
cannot be acquired through indoc- 
trination (1966:16) 
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Atiitudti towirdt Science 

When this broad category of attitudes 
is considered, the situation is no more 
encouraging. There is wide variation of 
topics considered to relate to this cate- 
gory. This is evident in Haladyna and 
Shaughnessy's categorization of studies 
they included in a meta-analysis study 
(1982). In reviewing rr^sei ;or this 
analysis, they classified stgo a* as relat- 
ing to scientific attitur.es. lo attitude 
toward scientists, to attitudes toward a 
method of teaching science, to scientific 
i nterests. to attitudes toward parts of the 
curriculum, and attitudes toward the 
subjec* of science. 

Gardner (1975) reviewed studies con- 
taining variables within the attitudes 
toward science category: interest, satis- 
faction, enjoyment. Qardnerconsidered 
the relationships between attitudes to 
science and other personal and social 
variables. He separated his discussion 
into studies of internal or personal vari- 
ables, which included other attitude var- 
iables, cognitive variables, personality 
and sex; and studies of external or social 
variables, which included nuch structural 
variables as home background, school 
environment variables, and curriculum 
and instructional variables. However, 
Gardner admitted that it was not always 
easy to classify a study ihto one of these 
two groups and that some external vari- 
ables were confounde.d with some inter- 
nal variables. 

Gardner said that there was support in 
the literature for the idea that attitudes 
are not isolated personal attributes but 
that they form broad and coherent pat- 
terns consistent with, and outgrowths 
of. deeper personality structures 
(1975:19). It was possible to find rela- 
tionships between students' attitudes to 
science and aspects of their personality. 
There was variation among studies in 
terms of age of students, gender, mea- 
suring instruments used, butthe general 
picture was that "... students who are 
favourably inclined towards science 
tend to be relatively serious and achieve- 
ment-oriented, realistic and indepen- 
dent, but conventional and conformist." 
(1975:22) 

According to Gardner, "Sex is prob- 
ably the single most important variable 
related to pupils* attitudes to science." 
.(1975:22) Sex differences apparently 
arise relatively early in life. Gardner 
wrote that there was a "substantial body 
of evidence" involving upper primary 
and secondary school pupils that boys 
have greater interest in science than do 
girls, with the differences appearing to 
carry over into adulthood. Thd nature of 
boys' and girls' interests in science also 
tended to differ, with boys relatively 
more interested in physical science and 
girls more interested In biology and^ 
social science. These differences also 
persist into adulthood. (1975:23) When 
social forces and sex differences are 



concerned, these forces appear to oper- 
ate through children's literature, paren- 
tal interest and behavior, and expecta- 
tions of teachers (1975:23). Gardner 
wonderc ' there were Innate cognitive 
differenuu.. jetween males and females 
which might Influence attitudes and en- 
rollment patterns (1975 ?4). 

Structural variables (geographic loca- 
tion, socioeconomic status) are probably 
proxy variables for factors such as paren- 
tal, peer group, and teacher behavior. 
When school variables were considered, 
classroom climate and teacher behavior 
have been studied. Gardner reported a 
study by Walberg in which it was found 
that classroom characteristics associ- 
ated with higher achievement were dif- 
ferent from those associated with better 
attitudes. Teacher behavior studies need 
to be reviewed with the caution that the 
same teacher behavior could have dif- 
ferent effects on different kinds of pupils 
(1975:26). Likewise, when looking at 
attitude studiesinvolving curriculum and 
instruction, the reader needs to keep in 
mind that teacher and pupil variables 
may exert more powerful effects on atti- 
tudes than the curriculum and instruc- 
tion variables do (1975:29). 

Gardner raised the question: to what 
extent do instruments now available ac- 
tually measure a common construct? 
This question has been studied and dis- 
cussed in detail by Munby. Before Mun- 
by's writings are reported, it seems ap- 
propriate to consider the various tech- 
niques that are used to obtain data on 
attitudes. 

Attitude Measurement Techniques 

Persons wishing to road in more detail 
about measurement techniquescan find 
additional information in an article by 
Gardner (1975), an occasional paper by 
Page and others (1975), and a review by 
Munby (1 983). Methods forgathering at- 
titude data vary. As Page and his col- 
leagues wrote, one method Is to ask 
direct or indirect questions. However, 
the person being questioned may be 
cued in providing a response by the 
phrasing of the question or may not wish 
to provide a truthful response or may 
decide to provide a response he/she con- 
siders socially acceptable. Another 
method would involve observation of the 
behavior of another individual and then 
an attempt to Infer the attitudes that 
person holds based on the behavior 
exhibited. Not only is this procedure 
time consuming but overt behavior may 
not be a true indicator of attitudes (Page 
et al.. 1975:3-4). Most attitude research 
involves the use of some kind of instru- 
ment. 

Gardner (1975:4-11) discussed nine 
different techniquesand/or instruments: 
differential (Thurstone) scales 
rating scales 
summated rating scales 
semantic differential scales 

O 
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Interest Inventories 
preference ranking 
projective techniques 
enrollment data 

other forms: clinical and anthropo- 
logical observation 

Differential scales, which Gardner 
terms Thurstone-type.' contain a num- 
ber of opinion statements designed to 
provide various positions on an attitude 
continuum. The scale is composed of a 
. large number of items, and respondents 
are asked to select those statements 
most closely resembling their own be- 
liefs. Each statement has a scale value 
so that the respondent's score is the 
mean or median of the scale values of 
the statements selected (1975:4). 
• Rating scales do not appear to be 
widely used in research on attitudes to 
science, according to Gardner. In this 
method, a particular concept is presen- 
ted and the rater places the ratee along a 
numerical scale. Sometimes self-report- 
ing is used (1975:5). 

Summated rating scales are more 
commonly used. In this technique a set 
of responses is available and each re- 
sponse has a weighting associated with 
it. the most commonly used form is the 
Likert-type scale. Each opinion state- 
ment reflects either a favorable or an 
unfavorable reaction and the respondent 
is asked to check a response usually 
ranging from strongly agree to strongly 
disagree (1975:5). 

Semantic differential scales consist of 
a word or phrase representing an atti- 
tude object which is followed by a list of 
bipolar adjectives. These adjectives lie 
at opposite ends of a seven-point scale, 
and the respondent marks a position on 
each scale for each adjective pair. 

Interest inventories, which may he 
either general or specific, contain items 
listing careers, topics, or activities and 
the respondent identifies those in which 
he/she is interested (1975:7). 

The preferenciB ranking technique in- 
volves having a respondent make com- 
parisons between enjoyment 6f science 
and enjoyment of other subjects. One 
defect of this technique Is that a student 
could have a positive attitude to all 
school subjects and rank science last 
while still having a more favorable atti- 
tude toward science than another re- 
spondent who disliked most school sub- 
jects and ranked science first (1575:9). 

Projective techniques are used in an 
attempt to reveal attitudes the respon- 
dent may havehidden. They may involve 
sentencecompletlon, word association, 
or interpretations of drawings (1975:9). 

Enrollment data may be used as indi- 
cators of attitudes for courses of the 
elective variety, assuming that there is a 
relationship between interestand enroll- 
ment. However, factors other than in- 
terest may influence enrollment 
(1975:10). 
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Clinical observations of students as 
they work or play may also be used to 
determine attitudes. Anthropological 
methods with the re.searcher as a partici- 
pant observer may also be used 
(1975:11). 

Methodological Issues 

Gardner. In his 1975 review, discussed 
five steps involved Inconstructing a valid 
and reliable attitude instrument: defini- 
tion of the attitude(s) to be measured, 
scale construction, trial, appropriate 
use. and appropriate choice of research 
design and statistical analysis (1 975:1 1 ). 
When one or more of these steps is 
ignored or inadequately carried out, 
problems result and the research whic^ 
results is questionable. 

The person developing an attitude 
instrument needs to clearly specify the 
theoretical construct which underlies 
this instrument. If more than one vari- 
able is to be measured, each should be 
specified in advanceand the instrument 
should yield separate scores for each 
separate variable. According to Gard- 
ner, these requirements are frequently 
ignored. Not only are theoretical con- 
structs lacking, items may be vague or 
ambiguous. Or items be In the form of a 
comple> sentence which contains jne 
part with which the respondent may 
agree and a second part with which 
he/she may disagree. Items may be in- 
cluded that do not reflect the construct 
the instrument purports to measure 
(1975: 12-14). 

The attitude instrument needs to be 
tried with a sample similar to the target 
population to be involved in the research 
study. The data collected need to be 
analyzed to determine if the instrument 
is sufficiently sensitive to discriminate 
among individuals, if it is internally con- 
sistent, and if It Is stable. Factor analysis 
mi!v be done to see If items have been 
corrertly allocated to scales and 
whether different scales 'oad on diffe;- 
ent factors (1975:14-16). 

When use is considered, Gardner 
urged that there needs to be some basis 
for arguing that there is a connection 
between the treatment and the outcome, 
but says this is frequently ignored In 
educational research. Subjects are fre- 
quently involved in atreatmentandthen 
asked to completv a test that is unrelated 
to the treatment (1975:16). Problems 
such as this may be avoided If the 
research design of the study is carefully 
examined and if appropriate statistical 
procedures are chosen, but these do not 
always prevent weaknesses In studies. 
That such weaknesses exist has been 
amply documented by Munby. 

Munby*s Investigation of Attitude 
Measurements 

Munby undertook to conduct a 
thorough examination of instruments 
designed to measure attitudes to 



science. In 1981 he presented a paper at 
the annual meeting of the National. 
Association for Research in Science 
Teaching (NARST) in which he reported 
on 30 studies \ti which one attitude 
instrument was used. This report even- 
tually appeared in print in 1963 in the 
Journal of Research in Science Teach- 
ing {1983b). The instrument was Moore 
and Sutman's Scientific Attitude Inven- 
tory (SAI). Asa part of his larger invosti- 
gation (1983a), Munby was interested in 
determining how frequently attitude in- 
stuments had been used in studies other 
than the one in which the instrument 
was first reported. 

Munby's review (1983a) covered the 
years 1967-1977. He considered six 
questions when reviewing the literature: 
(1) what is an appropriate instrument for 
measuring attitudes. (2) what instru- 
ments are available. (3) what model or 
conception of an attitude to science do 
they embpdy, (4) how do the instru- 
ments perform. (5) do they measure 
attitudes to science or scientific atti- 
tudes or both, and (6) do they avoid 
testing knowledge of science-related 
affairs? Munby was motivated by a lar- 
ger quQotton: what confidence can we 
have in instruments purported to mea- 
sure attitudes to science? 

Munby'ts search of the literature on 
attitude ' iieasurement in science educa- 
tion resulted in the identification of over 
200 instruments. While Munby agreed 
that any evah ^ition of science curricula 
should consiJer affective as well as 
cognitive outcomes, he suggested that a 
moratorium on instrument development 
was needed (1983a:7). He also hypothe- 
sized that because there were so many 
attitude instruments reported in the lit- 
erature, the science education commun- 
ity must not be carefully scrutinizing 
these instruments to see If they were 
indeed reliable and valid. Munby specu- 
lated that the findings, reported in the 
literature, of a decline in student atti- 
tudes might be due to defective instru- 
ments (1983a:27). Such defective instru- 
ments need to be removed from use or 
their defects remedied, if possible. In 
order to accomplish either of these 
goals, it was necessary to study the 
instruments. 

In his review of the literature, Munby 
attempted to collect all research in 
which an instrument for measuring atti- 
tudes to science was cited. If the instru- 
ment was not part of the literature, he 
wrote to the author. He was able to 
develop files on 204 instruments. Such 
files consisted of the instrument, a paper 
on its development and characteristics, 
and reports of research in which the 
instrument was used (1983a:46). He 
limited his investigation to instruments 
related to the construct ''attitude to 
science" and did not deal with any 
"scientific attitude" instruments in his 
analysis. 



Munb / limited his analysis to instru- 
ments that used the Likert or Thurs^one 
scales or multiple choice questionnaires. 
Instruments using the semantic differ- 
ential or projective techniques were not 
analyzed. 

Instruments which Munby identified . 
and located but did not analyze were 
included in the appendices of his report 
(1963a^ so these are not lost but are 
available for study. 

Munby'3 report contains 12 appen- 
dices, as follows: 

A. Semantical Differential instru- 
ments (30) 

B. Projective Instruments (5) 

C. Instruments Measuring Scientific 
Attitudes (14) 

D. Instruments Measuring Science 
Career Preferences (6) 

E. Instruments Measuring Attitudes 
about Science Teaching (6) 

F. Instruments Measuring Attitudes 
to Specific Science Subjects and 
Subject Preferences (27) 

G. Instruments Measuring Science 
Interests and Activities (20) 

H. Instruments Measuring Attitudes 
toScience Courses and Science in 
School (24) 

I. Instruments Measuring Attitudes 

to Specific Science Issues (1) 
J. Unavailable Instruments (15) 
K. Those Selected for Detailed Study 
(56) 

L. Detailed Description and Analysis 
of 56 Attitude Instruments. 

Munby chose to analyze attitudes to 
science (56 instruments) and devised 
what he termed a "clue structure" to use 
in his analysis. A detailed explanation 
this clue structure and how it was dje- 
rived is found in chapter two of Munby's 
report (198aa). ' 

Munby reported that 56 of the instru- 
ments purported to measure attitudeis to 
science used the Likert forma^ for 
gathering data. Twenty-one of the 56 
were used in more than one research 
study. Munby considered this unrieces- 
sary duplication (in developing instru- 
ments) and called for better coryimuni- 
cation within the research comnrlunity. 

Twenty-oneof the56instrum^nts had 
no reported reliabilities (19§'3a:106). 
There was a new calculation of feliability 
reported for only seven instruments 
used in more than one study^ although 
21 instruments were used rtiore than 
once. Munby considered thatThurstone 
and Likert type instruments should have 
a reliability coefficient of .8. Munby 
wrote that If the reliability coefficient 
was less than .7, "another reliability 
tryout is needed." (1983a:l11). Thirty- 
one of the 56 instruments had reliability 
coefficients of .7 or above. 

Munby also examined the instruments' 
validity: did they mea^lire what they 
purport to measure? Fpr 18 of the 56 
instruments, there was' no evidence to 
indicate that validity had been estab- 



llsherJ. Munby Is skeptical of the deter- 
minavion of validity by the use of a panel 
of judges, citing soir:e remarks by Lucas 
to the effect that the panel method rests 
on a myth of the majority being right 
(1983a:115). So. if those instruments 
whose validity was determined by this 
method were removed from the analysis.* 
nine more instruments could be set 
aside. Only seven instruments had valid- 
ity determined by two or more psycho- 
metric methods (1983a:115-1l6), 

Munby also considered whether the 
attitude instruments included items that 
measured cognitive knowledge. Only 4 
instruments contained no cognitive 
items. Cognitive items made up 50 per- 
cent or more of 17 instruments and 18 
instruments had 25 percent or more 
items that were cognitive. Munby sug- 
gested that the inclusion of cognitive 
items helps explain why so many find- 
ings of nosignificant differences appear 
in attitude research in sclenceeducation 
when attitudes are measured before and 
after treatmerit.-^lf cognitive items are not 
related to the treatment (some experi- 
mental course or teaching methodol- 
ogy), scores are likely to be unaffected 
'by the treatment (1d83a:l29). It is 
Munby's opinion that having a 
number of cognitive Items in an attitude 
instrument makes the validity of this 
instrument very questionable) (1983a: 
132). 

When Munby considered the prob- 
lems of reliability, validity, and what 
items seemed to be testing, his pool of 
56 instruments diminished. If those in- 
struments Munby considered incom- 
plete or not strictly measuring attitudes 
toscience were removed, 50 instruments 
remained. When this group of 50 was 
culled to remove those whose reliability 
was not known, 33 were left foranalysls. 
From this group were removed those 
instruments with reliability coefficients 
of less than .7; 29 instruments remained. 
From these 29 were removed those in- 
struments whose validity was not tested 
orwas established by the panel of judges 
method. Thore were seven survivors and 
even theses were considered, by Munby, 
to be suspect on one basis or another 
(I983a:132-140). 

In the final chapter of Munby's report 
he attempted to describe what he con- 
sidered to be the situation in attitude 
research in science education. It is a 
large field of study but one which has 
not been wel[ reviewed. Most of the 
reviews are selective and uncritical. 
Most reviews ''eport what exists rather 
than evaluating it. It is Munby's conten- 
tion that instrument developers are not 
doing all they could to assure that their 
instruments may be used with confi- 
dence. Other users seem to take validity 
and reliability for granted. Of those 21 
attitude Instruments used in more than 
one study, only 6 had a "fresh determin- 
ation of reliability" (1983d:144) [on page 



110 in this same document Munby re- 
ported this number as 7, not 6). In only 
twostudies wasthoroan investigation of 
the validity of the instrument used 
(ig83a:144). 

Munby was also concerned o^er the 
fact that instrument developers mix 
scientific attitude items with Items of 
attitudes toward science and that they 
include a high percentage of cognitive 
items in instruments aimed at measur- 
ing attitudes. Munby said, ". . . Evidently 
there are conceptual problems in the 
construction of instruments measuring 
attitudes to science . . /' (1983a:144). 
Perhaps if these concyptual problems 
were resolved, many of che conflicting 
research findings could be explained. 

Munby speculated that the term 
•clence may be ambiguous and that 
what is needed are subscales or scales 
for target concepts si'ch as "science in 
school" or "science careers" etc. He also 
pointed out that, because science is so 
much a part of daily l.fe, it ". . . may be 
difficult to get at ja person's attitudes to 
science if heorshe is nottotallyawareof 
the extent to which science is a part of 
his or her intellectual and physical life 
. . ." (1983a:146). 

Just as the members of the Educa- 
tional Policies Commission wrote that 
the values of science are not taught by 
indoctrination. Munby was concerned 
about science educators' motives for 
cultivating positive attitudes in.their stu- 
dents. He raised the question of whether 
getting students to like science or to feel 
positive about it should be considared 
an acceptable educational objective or 
some form of indoctrination. It is 
Munby's conclusion that science educa- 
tion experiences should foster knowl- 
edge and understanding, and from these 
should grow personal preferences and 
attitudes (ig83a:148). 

As Gauld called for a reconceptualiza- 
tion of "scientific attitude." so. too. 
Munby called for a reconceptualization 
of "attitude to science." 

Recommendations for Research 

Numerous writers have recommenda- 
tions for improving attitude research. 
Munby included seven recommenda- 
tions which he categorized as varying 
from mundane to significant. (1) Better 
written abstracts are needed in Disserta- 
tion Abstracts International, as well as 
more complete coverage of di.^serta- 
tions. If necessary, guidelines forv^Titing 
abstracts should be provided to doctoral 
candidates and their major advisors. (2) 
Attitude instruments should be put into 
the ERIC system. This woutd result in 
the assigning of an ED number to the 
instrument and any related papers. 
Then, when an instrument was reported 
m a journal article, the ERIC reference 
could be included so that readers could 
find and retrieve the instrument that 



space limitations precluded from publi- 
cation as part of the article. (3) Attitude 
instruments used In research should 
first be thoroughly examined for reli- 
ability and validity. (Page et al, 1983:7, 
contend there are no truly adequate 
methods for assessing the validity of 
attitude scales.) (4) Proper instrument 
development is such an exacting task 
that the development of a valid and 
reliable instrument should be con- 
sidered worthy of dlsse'^tation require- 
ments. The usual situation is that an 
instrument isdeveloped in ordertouseit 
in the dissertation study. As a result, 
instrument development is a secondary 
goal of the study, not the primary one, 
and. as a result, the development pro- 
cess is not as thorough and sound as it 
should be. (5) Researchers interested in 
attitude measurement in science educa- 
tion needto review the other instruments 
fro:Ti the pool of 200 Munby identified 
before producing any new instruments. 
The 30 instruments in the semantic dif- 
ferential format deserve further review. 

(6) Research needs to be done to deter- 
mine influence of cognitive Items, in 
attitude instruments, on attitude scores. 

(7) Research needs to be done on the 
effect of instrument length on attitude 
scores and on contradictory findings 
(1983a:149-154). 

Haladyna and Shaughne&sy (1982) 
provided support for Munby's first and 
second recommendations. Their frus- 
tration with what they termed "nonsyn- 
thesizable" reports for their meta-analy- 
sis project .led them to say that, at a 
minimum, a research report should in- 
clude (a) a description of the sample, 
including numbers of males and females 
and grade levels involved; (b) a descrip- 
tion of instrumentation including reli- 
ability estimates and evidence of validity 
as well as information about obtaining 
the instrument (they also suggested that 
instruments be put into the ERIC sys- 
tem); (c) appropriate analysis proce- 
dures, and data presented in a format 
that communicates the essence of the 
findings as well as the magnitudes 
(italics the authors') of the effects 
(1982:558-559). 

Gaulo and Hukins (1980) grouped 
their recommendations as dealing with 
needs for improvement in communica- 
tion, for an increase in conceptual clar- 
ity, for sustained research, and for the 
use of innovative techniques. They sug- 
gested that communication could be 
improved if there were more uniformity 
in the terms used and recommended 
that researchers become more familiar 
with Klopfer's taxonomy of objectives in 
the affective domain. (This taxonomy is 
described in detail in chapter 19. "Evalu- 
ation of Learning in Science." in the 
Handbook on Formative andSummative 
Evaluation of Student Learning by 
Bloom. Hastings and Madaus, 1971: 



559-641.) 

Qauld and Hukins wrote. "The survey 
approach adopted by many people for 
Identifying components of the scientific 
attitude has turned attention away from 
the need to think seriously about what 
the scientific attitude is and how its 
components are related to one another 
at a theoretical level. . . (1980:153). 
They recommended that researchers 
needed to make explicit references to 
the model of science upon which Iheir 
particular piece of research was based. 
They also stated that researchers need 
to be more aware of the complexity of 
those processes leading to the behaviors 
used to itidicate the possession of par- 
ticular scientific attitudes. 

Gauld and Hukins argued for the need 
for coherence in research in science 
education and hypothesized that pro- 
gress in research could be achieved 
through groups adopting a particular 
framework then spending a great deal of 
effort carrying out investigations within 
that framework, as compared to many 
people doing a lot of different things. 
They also pointed out that, if research 
on scientific attitudes is to be of value to 
the classroom teacher, more attention 
needs to be given to studying the effects 
of particuiarteaching strategies, teacher 
characteristics, and the interaction 
between these and pupil characteristics 
on the development of attitudes. They 
considered that innovative techniques 
are needed in attitude research so that 
respondents answer honestly rather 
than attempting to please the teacher or 
researcher (1980:154). 

Schibeci (1983). in an article focused 
on the topic of selecting appropriate 
attitudinal objectives for school science, 
expressed some reservations about atti- 
tude research. His comments agreed 
with thoseof otherwriters when he said. 
"The poor psychometric qualities of 
many instruments used to assess atti- 
tudes is a major problem." (1983:599). 
Schibeci was also concerned that most 
attitude researchers did not consiaerthe 
competing influence of school and non- 
school variables on attitudes. Schibeci 
considered such studies to be important 
but acknowledged that they are more 
expensive and difficult to undertake— 
reasons for their not being done. Also 
not adequately studied, according to 
Schibec*. is the stability of attitudes. 
Researchers do not try to determine how 
long an exhibited change in attitude 
lasts. Perhaps if science education re- 
searchers were to act on Gauld and 
Hukin's suggestion for setting up sus- 
tained research efforts, some longitu- 
dinal studies could be done. 

What Does All This Mean? 

Writers have called for reconceptuali- 
zation of the two major categories of 
attitude measured by science education 
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researchers: scientific attitudes and atti- 
tudes toward science. Qauld Wrote that 
when we as science teachers attempt to 
develop in our students the behaviors 
we characterize as those exhibited by 
scientists, we are creating a faise i mage. 
Munby advocates that we work on 
knowledge and understanding of 
science and let our students deveiop 
their own preferences anv. attitudes. 
Various writers have criticized the 
shortcomings of the methodoiogy in- 
voived in attitude studies in science 
education. Munby nas caiied for a mora- 
torium on attitude instrument deveiop- 
ment. Should we leave the fieid of atti- 
tude research and concentrate our 
efforts in another direction? 

Such an action does not seem to be 
the intent of any of the authors reviewed. 
All want the situation to be improved so 
that we can put more faith in what we 
read when attitude research is reported. 
As Schibeci wrote, '*A general, basic 
assumption of curriculum writers and 
researchers is that we can change atti- 
tudes in the desired direction . . ." 
(1983:600). V'hat we need to keep in 
mind is that we probably cannot change 
all students without resorting to tech- 
niques that could be described as indoc- 
trination or brainwashing. We also need 
to thoroughly question our assumption 
that because we have had success' in 
helping students achieve objectives in 
the cognitive domain, we can expect 
similar results with affective objectives. 



Schibeci argued that it is dangerous for 
curriculum writers (and others) to as- 
sume that attitudinal objectives may be 
treated in the same way as cognitive 
objectives (1983:601). Schibeci said: 
There appears to have arisen a 
vague assumption that attitudinal 
objectives are a "natural" part of a 
specification for a science curri- 
culum. This assumption needs to 
be examined more criticftily by 
curriculum writers than has been 
done to date. A much clearer, ex- 
plicit justification for inclusion of 
attitudinal objectives needs to be 
provided, both for curriculum and 
research purposes. (1983:601) 

Each year the ERIC Clearinghouse for 
Science. Mathematics, and Environ- 
mental Education cooperates with the 
National Association for Research in 
Science Teaching to producea review of 
the science education research pub- 
lished in the previous calendar year. 
Beginning in 1973 these reviews have 
been published as a part of the material 
in the journal Science Education. These 
annual reviews for the years 1973 
through 1982 were examined to see 
what the authors had to say about any 
attitude research they reviewed. The 
most specific comments were found in 
the review for 1977 (Peterson and Carl- 
son). These reviewers said that attitude 
research is chaotic because we in sci- 
ence education have allowed it to be- 
come so. They suggested that, to make 
order out of this chaos, a series of con- 
ferences on attitude research and/or a 
specialized journal might be useful. 

It seems obvious that there is much 
work to bedc ^eand that there are many 
people interested in attitudes. Improved 
communication among this group, 
combined with more attention to 
methodological issues, would appear to 
be some issues that should receive 
priority from science educators inter- 
ested in attitude measurement. These 
individuals would do well to keep in 
mind Zeidler's comments in reaction to 
Munby's article (1983b). Zeidler said 
that Munby's critique of the Moore and 
Sutman Scientific Attitude Inventory 
and its use brought to light a more 
fundamental validity problemof much of 
the attitudinal research in science edu- 
cation. Science education researchers 
borrow from other disciplines without 
giving adequate attention to the theo- 
retical guidelinesalreacyestablished by 
those disciplines. In social psychologi- 
cal studies attitude is associated with 
one's beliefs, intentions and behaviors 
with respect to a given object or exper- 
ience. Zeidler agreed that conceptual 
analysis is needed but not until science 
educators have considered whether or 
not their instruments are developed in a 
manner consistent with the formal cri- 



teria and theoretical guidelines of social 
psychology in the validation process 
(1984:341). 

by Patricia E. Blosser, Associate Direc- 
tor, User Services 
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